Memorization Weights for Instance Reweighting in Adversarial Training

نویسندگان

چکیده

Adversarial training is an effective way to defend deep neural networks (DNN) against adversarial examples. However, there are atypical samples that rare and hard learn, or even hurt DNNs' generalization performance on test data. In this paper, we propose a novel algorithm reweight the based self-supervised techniques mitigate negative effects of samples. Specifically, memory bank built record popular as prototypes calculate memorization weight for each sample, evaluating "typicalness" sample. All reweigthed proposed weights reduce Experimental results show method flexible boost state-of-the-art methods, improving both robustness standard accuracy DNNs.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning Instance Weights in Multi-Instance Learning

Multi-instance (MI) learning is a variant of supervised machine learning, where each learning example contains a bag of instances instead of just a single feature vector. MI learning has applications in areas such as drug activity prediction, fruit disease management and image classification. This thesis investigates the case where each instance has a weight value determining the level of influ...

متن کامل

Adversarial Training for Relation Extraction

Adversarial training is a mean of regularizing classification algorithms by generating adversarial noise to the training data. We apply adversarial training in relation extraction within the multi-instance multi-label learning framework. We evaluate various neural network architectures on two different datasets. Experimental results demonstrate that adversarial training is generally effective f...

متن کامل

Adversarial Training for Sketch Retrieval

Generative Adversarial Networks (GAN) can learn excellent representations for unlabelled data which have been applied to image generation and scene classification. The representations have not yet to the best of our knowledge been applied to visual search. In this paper, we show that representations learned by GANs can be applied to visual search within heritage documents that contain Merchant ...

متن کامل

A Multivariate Training Technique with Event Reweighting

The performances of Artificial Neural Networks and Boosted Decision Trees using equal event weight and effective event weight training are compared in this paper. The comparison is performed in the context of the physics analysis of the ATLAS experiment at the Large Hadron Collider (LHC), which will explore the fundamental nature of matter and the basic forces that shape our universe. Based on ...

متن کامل

Instance memorization and category influence: challenging the evidence for multiple systems in category learning.

A class of dual-system theories of categorization assumes a categorization system based on actively formed prototypes in addition to a separate instance memory system. It has been suggested that, because they have used poorly differentiated category structures (such as the influential "5-4" structure), studies supporting the alternative exemplar theory reveal little about the properties of the ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i9.26329